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CONSERVATIVE AND DISSIPATIVE POLYMATRIX 

REPLICATORS 

HASSAN NAJAFI ALISHAH, PEDRO DUARTE, AND TELMO PEIXE 


Abstract. In this paper we address a class of replicator dynam¬ 
ics, referred as polymatrix replicators, that contains well known 
classes of evolutionary game dynamics, such as the symmetric and 
asymmetric (or bimatrix) replicator equations, and some replica¬ 
tor equations for n-person games. Polymatrix replicators form a 
simple class of algebraic o.d.e.’s on prisms (products of simplexes), 
which describe the evolution of strategical behaviours within a po¬ 
pulation stratified in n > 1 social groups. 

In the 80’s Raymond Redheffer et al. developed a theory on 
the class of stably dissipative Lotka-Volterra systems. This theory 
is built around a reduction algorithm that “infers” the localization 
of the system’ s attractor in some affine subspace. It was later 
proven that the dynamics on the attractor of such systems is always 
embeddable in a Hamiltonian Lotka-Volterra system. 

In this paper we extend these results to polymatrix replicators. 


1. Introduction 


Lotka-Volterra (LV) systems were introduced independently by Al¬ 
fred Lotka |3i0 and Vito Volterra j50| to model the evolution of biologi¬ 
cal and chemical ecosystems. The phase space of a Lotka-Volterra sys¬ 
tem is the non-compact polytope M" = {x G R n : Xi > 0, i — 1,..., n}, 
where a point in M n represents a state of the ecosystem. The LV sys¬ 
tems are defined by the following o.d.e. 


dxi 

dt 


Xifi{x), i 


1 


where usually the so called fitness functions ffix) are considered to be 
affine, i.e., of the form 


ffix) = Vi + y^ j a ij x j , 

3 = * 1 


where A = (a^) € Mat nxn (M) is called the system’s interaction matrix. 

In general, the dynamics of LV systems can be arbitrarily rich, as was 
first observed by S. Smale |46| who proved that any finite dimensional 
compact flow can be embedded in a LV system with non linear fitness 
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functions. Later, using a class of embeddings studied by L. Brenig j5], 
B. Hernandez-Bermejo and V. Fairen |15], it was proven (see [15], The¬ 
orems 1 and 2]) that any LV system with polynomial fitness functions 
can be embedded in a LV system with affine fitness functions. Com¬ 
bining this with Smale’s result, we infer that any finite dimensional 
compact flow can be, up to a small perturbation, embedded in a LV 
system with affine fitness functions. These facts emphasize the diffi¬ 
culty of studying the general dynamics of LV systems. 

In spite of these difficulties, many dynamical consequences have been 
driven from information on the fitness data fi{x) for some special 
classes of LV systems. Two such classes are the cooperative and compet¬ 
itive LV systems, corresponding to fitness functions satisfying ^ > 0 


and < 0, respectively, for all i,j. Curiously, the fact that Smale’s 


embedding takes place in a competitive LV system influenced the de¬ 
velopment of the theory of cooperative and competitive LV systems 
initiated by M. Hirsch 


18-20 


In his pioneering work Volterra [50 studies dissipative LV systems as 
generalizations of the classical predator-prey model. A LV system with 
interaction matrix A = {a l3 ) is called dissipative, resp. conservative, 
if there are constants di > 0 such that the quadratic form Q(x) = 
Y2ij=i UijdjXiXj is negative semi-definite, resp. zero. Note that the 
meaning of the term dissipative is not strict because dissipative LV 
o.d.e.s include conservative LV systems. In addition we remark that 
conservative LV models are in some sense Hamiltonian systems, a fact 
that was well known and explored by Volterra. 

Given a LV system with interaction matrix A = (a^), we define 
its interaction graph G{A) to be the undirected graph with vertex set 
V = {1 ,... ,n} that includes an edge connecting i to j whenever a i3 ^ 0 
or a ji 7^ 0. The LV system and its matrix A are called stably dissipative 
if £• y=i aijXiXj < 0 for all x G M n and every small enough perturba¬ 


tion A = ( dij) of A such that G(A) = G(A). This notion of stably 
dissipativeness is due to Redheffer et al. whom in a series of papers 
136-401 studied this class of models under the name of stably admissible 
systems. 

Assuming the system admits an interior equilibrium q G int(R”), 
Redheffer et al. describe a simple reduction algorithm, running on the 
graph G{A), that ‘deduces’ the minimal affine subspace of the form 
fl i & i{x G R™ : Xi = qi} that contains the attractor of every stably 
dissipative LV system with interaction graph G{A). 

Under the scope of this theory, Oliva et al. [ 11 ] have proven that the 
dynamics on the attractor of a stably dissipative LV system is always 
described by a conservative (Hamiltonian) LV system. 

The replicator equation, which is now central to Evolutionary Game 
Theory (EGT), was introduced by P. Taylor and L. Jonker [481. It 
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models the time evolution of the probability distribution of strategical 
behaviors within a biological population. Given a payoff matrix A G 
Mat nxn (M), the replicator equation refers to the following o.d.e. 


x[ = Xi ((Ax)i , i — 1 ,..., 


n 


on the simplex A”” 1 = {x G M" : fZ'j=\ x ] = 1}- This equation says 
that the logarithmic growth of the usage frequency of each behavioural 
strategy is directly proportional to how well that strategy fares within 
the population. 

Another important class of models in EGT, that includes the Bat¬ 
tle of sexes , is the bimatrix replicator equation. In this model the 
population is divided in two groups, e.g. males and females, and all 
interactions involve individuals of different groups. Given two payoff 
matrices A G Mat nxm (M) and B G Mat mxn (M), for the strategies in 
each group, the bimatrix replicator refers to the o.d.e. 


x\ =x i ((Ay) i -x t Ay) i = 1,. 
y'j = Vj (( Bx )j ~y t Bx) j = 1, 


, n 
, m 


on the product of simplices A n 1 x A m 1 . It describes the time evo¬ 
lution of the strategy usage frequencies in each group. These systems 


were first studied in [43] and 44 . 

We now introduce the polymatrix replicator equation studied in |3|. 
Consider a population is divided in p G N groups, a = 1 ,,p, each 
with n a G N behavioral strategies, in a total of n = y^_ L n a strategies, 
numbered from 1 to n. The system is described by a single payoff 
matrix A G Mat nxn (M), which can be decomposed in p 2 blocks A 01,13 G 
Mat^xn.W with the payoffs corresponding to interactions between 
strategies in group a with strategies in group j3. Let us abusively write 
iGato express that * is a strategy of the group a. With this notation 
the polymatrix replicator refers to the following o.d.e. 


Xa Xn 


({Ax)i - 

\ j&a 


Xj (. Ax)j , i G a, a G {1,... ,p}. 


on the product of simplexes A” 1-1 x ... x A rap_1 . Notice that inter¬ 
actions between individuals of any two groups (including the same) 
are allowed. Notice also that this equation implies that competition 
takes place inside the groups, i.e., the relative success of each strategy 
is evaluated within the corresponding group. 

This class of evolutionary systems includes both the replicator equa¬ 
tion (when p = 1) and the bimatrix replicator equation (when p = 2 
and A 1,1 = 0 = A 2,2 ). It also includes the replicator equation for 
?x-person games (when A a,a = 0 for all a = 1,... ,p). This last sub¬ 
class of polymatrix replicator equations specializes more general repli¬ 
cator equations for ?x-person games with multi-linear payoffs that were 
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first formulated by Palm 
Plank 34 among others. 


33 and studied by Ritzberger, Weibull |41 


In this paper we define the class of admissible polymatrix replicators 
(the analogue of stably dissipative for LV systems), and introduce a 
reduction algorithm similar to the one of Redheffer that ‘deduces’ the 
constraints on the localization of the attractor. We also generalize the 
mentioned theorem in 


11 


to polymatrix replicator systems. 


This paper is organized as follows. In Section [2] we introduce the 
notion of polymatrix game as well as its associated polymatrix repli¬ 
cator system (o.d.e.), proving some elementary facts about this class 
of models. In Section [3] we recall some known results of Redheffer et 
al. reduction theory for stably dissipative LV systems. In sections [4] 
and [5j we define, respectively, the classes of conservative and dissipa¬ 
tive polymatrix replicators, and study their properties. In particular, 
we extend to polymatrix replicators the concept of stably dissipative¬ 
ness of Redheffer et al.. We generalize to this context the mentioned 
theorem in 1111 about the Hamiltonian nature of the limit dynamics 
of a “stably dissipative” system. Finally, in Section [ 6 ] we illustrate our 
results with a simple example. 


2. Polymatrix Replicators 

Definition 2.1. A polymatrix game is an ordered pair (n, A) where 
n = (ni ,..., n p ) is a list of positive integers, called the game type, and 
A G Mat nxn (M) a square matrix of dimension n — n\ + ... + n p . 

This formal definition has the following interpretation. 

Consider a population divided in p groups, labeled by an integer a 
ranging from 1 to p. Individuals of each group a — 1,... ,p have exactly 
n a strategies to interact with other members of the population. The 
strategies of a group a are labeled by positive integers j in the range 

ni + ... + n a -1 < j < ni + ... + n a . 

We will write j G a to mean that j is a strategy of the group a. Hence 
the strategies of all groups are labeled by the integers j = 1 ,... , n. 

The matrix A is the payoff matrix. Given strategies iGa and j G /3, 
in the groups a and j3 respectively, the entry a tJ represents an average 
payoff for an individual using the first strategy in some interaction 
with an individual using the second. Thus, the payoff matrix A can be 
decomposed into n a x ny block matrices A Q,/3 , with entries a t j , 1 G a 
and j G /3, where a and (3 range from 1 to p. 

Definition 2.2. Two polymatrix games (n,A) and (n,B) with the 
same type are said to be equivalent, and we write (n, A) ~ fe B), 
when for a, (3 = 1 ,... ,p, all the rows of the block matrix A a ‘ 3 — B a/3 
are equal. 





DISSIPATIVE POLYMATRIX REPLICATORS 


5 


The state of the population is described by a point x 
prism 


T„ := A ni_1 x ... x A np_1 C R n , 


(x a ) a in the 


n a 

where A n “ _1 = (x G : Yh x i — 1}, x a = ( x j)j£a and the entry Xj 

i =1 

represents the usage frequency of strategy j within the group a. The 
prism T n is a ( n — p)-dimensional simple polytope whose affine support 
is the (n — p )-dimensional space E n ~ p C M n dehned by the p equations 


Xi = 1, 1 < a < p . 

i^a 


Definition 2.3. A polymatrix game (n, A) determines the following 
o.d.e. on the prism T„ 

dxi I , . 

n = x< 

called a polymatrix replicator system. 


Y^(x a ) T A a ^x P Y V*6a, 1 < a < p , (2.1) 


0=i 


This equation says that the logarithmic growth rate of each frequency 
Xi is the difference between its payoff (Ax)i = a ij x j an d fl ie 

average payoff of all strategies in the group a. The flow <f> t nA of this 
equation leaves the prism T n invariant. Hence, by compactness of T„, 
this flow is complete. The underlying vector field on T n will be denoted 
by X A ,n- 

In the case p — 1, we have T n = A 71 ^ 1 and 
replicator equation associated to the payoff matrix A. 

When p — 2, and A 11 = A 22 = 0, T n = A" 1-1 x A n2_1 and 
conies the bimatrix replicator equation associated to the pair of payoff 
matrices (A 12 , A 21 ). 

The polytope T„ is parallel to the affine subspace 


(2.1) be- 


(2.1) is the usual 


H n 



for a 



( 2 . 2 ) 


For each a — 1,... ,p, we denote by n a : W 1 —> M n the projection 


x ^ V, Vi 


Xi if i G a 

0 if i £ a 


We also define 1:= (1,...,1) GM". 


Lemma 2.4. Given a matrix C G Mat nX n(®0j the following statements 
are equivalent: 

(a) C a/3 has equal rows, for all a, /3 G {1,... ,p}, 

(b) Cx G Hf~, for all x G M n . 

Moreover, if any of these conditions holds then Xn,c = 0 on T„. 
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Proof. Assume (a). Since Hf is spanned by the vectors 7r a (l) with 
a = 1,... ,p, we have v G iff u* = Vj for all i,j G a. Because 
all rows of C in the group a are equal, we have (Cx)i = (Cx)j for all 
i,j G a. Hence item (b) follows. 

Next assume (b). For all i G a, with a G {l,...,p}, Ce* G 
which implies that for all j G a. This proves (a). 

If (a) holds, then for any a G {1,... ,p}, i,j G a and k — 1,..., n, we 
have Cik = Cjk■ Hence for any x G and i , j G a with a G p}, 

(C x)i = (C x)j, which implies that X n c = 0 on r„. □ 

Proposition 2.5. Given two polymatrix games ( n,A ) and (n,B) with 
the same type n, if (n, A) ~ (n, B) then Xn,A = X^m on 

Proof. Follows from Lemma [274] and the linearity of the correspondence 
A e-)- Xn,A- D 

We have the following obvious characterization of interior equilibria. 

Proposition 2.6. Given a polymatrix game (n, A), a point q G int(r n ) 
is an equilibrium of X 1Jl) a if and only if ( Aq) t = ( Aq)j for all i,j G a 
and a — 1,... ,p. 

In particular the set of interior equilibria of Xn,A is the intersection 
of some affine subspace with int(r„). 


3. Lotka-Volterra systems 


The standard sector 

K+ = (0i, ..., x n ) G M n : Xi > 0, Vi G {1,..., n}}. 
is the phase space of Lotka-Volterra systems. 

Definition 3.1. We call Lotka-Volterra (LV) to any system of differ¬ 
ential equations on MV of the form 


'A; Xj 



i = 1, 


,n 


(3,1) 


In the canonical interpretation (3.1) models the time evolution of 


an ecosystem with n species. Each variable Xi represents the density 
of species i, the coefficient r t stands for the intrinsic rate of decay 
or growth of species i, and each coefficient a , 3 represents the effect 
of population j over population i. For instance a t j > 0 means that 
population j benehts population i. The matrix A = (dij)i<i,j<n 


is 


called the interaction matrix of system (3.1). 


The interior equilibria of (3.1) are the solutions q G M” of the lion- 
homogeneous linear equation r + Ax = 0. Given A G Mat nxn (M) and 
q G M n such that r + Aq = 0, the LV system (|3.1 ) can be written as 


dx 

— = X Aq (x) \= x * A{x 


q), 


(3,2) 
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where * denotes the point-wise multiplication of vectors in 


Definition 3.2. We say that the LV system (3.2), the matrix A, or the 
vector field Xa, q , is dissipative iff there is a positive diagonal matrix 
D such that Qad(x ) = x T ADx < 0 for every x G M n . 

Proposition 3.3. If Xa, q is dissipative then, for any D = diag(dj) as 

(3.3) 


in Definition 3.2, Xa, q admits the Lyapunov function 

Xi - Qi logXi 


h(x) =Y.~ 


i= 1 


dr 


which decreases along orbits of Xa, q - 

Proof. The derivative of h along orbits of Xa )Q is given by 


h(x) V ^ (.r, - qf)(xj - qj) = (x - q) T D 1 A(x - q) 
i,j =1 % 

= [D~\x - q)] T AD[D-\x - q)} < 0. 


□ 


We will denote by Ker(A) the kernel of a matrix A. 

Proposition 3.4. If A G Mat nX n(R) dissipative and D is a positive 
diagonal matrix such that Qad < 0 then Ker(kL) = DKer(A T ). 

Proof. Assume first that Qa < 0 on M n and consider the decomposition 
A = M + N with M = (A + A T )/2 and N = {A — A T )/ 2. Clearly 
Ker(M) D Ker(A^) C Ker(A). On the other hand, if v G Ker(A) then 
v T M v = v T A v — 0. Because Qm = Qa < 0 this implies that M v = 0, 
i.e., v G Ker(M). Finally, since N = A — M, v G Ker(iV). This 
proves that Ker(A) = Ker(M) D Ker(A^). Similarly, one proves that 
Ker(A T ) = Ker(M) 0 Ker(A^). Thus Ker(A) = Ker(A T ). 

In general, if Qad < 0, we have Ker (fAD) T ) = Ker {DA T ) = Ker(A T ), 
and Ker (AD) = D _1 Ker(A). Thus, from the previous case applied to 
AD we get D~ 1 Ker(A) = Ker(A T ). □ 


Proposition 3.5. Any dissipative LV system admits an invariant fo¬ 
liation on int(M”) with a unique equilibrium point in each leaf. 

Proof. See [12, Proposition 2.1 and Theorem 2.3]. □ 


On the rest of this section we focus attention on LV systems with 
interior equilbria q G int(M”). In this case the Lyapunov function h is 
proper, and hence the forward orbits of (3.2) are complete. Therefore, 
the vector field Xa )Q induces a complete semi-flow (j) t Aq on int(R”). 


Definition 3.6. Given a matrix A = (a t j) G Mat nxn (M) of a LV sys¬ 
tem, we define its associated graph G(A) to have vertex set {1,..., n}, 
and to contain an edge connecting vertex i to vertex j iff a t j ^ 0 or 
7 ^ O’ 
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Given a matrix A = (a tJ ) G Mat nxn (M) we call admissible perturba¬ 
tion of A to any other matrix A = (a^) G Mat nxn (M) such that 

dij ~ aij and a VJ = 0 <$■ a VJ — 0. 

By definition, admissible perturbation are perturbations of A such that 

G(A) = G{A). 


Definition 3.7. A matrix A G Mat nxn (M) is said to be stably dissipa¬ 
tive if any small enough admissible perturbation A of A is dissipative, 
i.e., if there exists £ > 0 such that for any admissible perturbation 
A = {dij) of A = (dij), 


max Ian — dal < £ 

l<ij<n 


A is dissipative. 


A LV system (3.2) is said to be stably dissipative if its interaction 
matrix is stably dissipative. 


Lemma 3.8. Let D be a positive diagonal matrix. If A is a stably 
dissipative matrix, then AD and D~ l A are also stably dissipative. 


Proof. Since A is dissipative there exists a positive diagonal matrix D' 
such that Qad 1 < 0, which is equivalent to Q(ad)(d~ 1 d') A 0. Hence 
AD is dissipative. Analogously, since Qad 1 < Owe have Qd~ 1 ad , d~ 1 {x) = 
QAD'iD-'x) < 0, which shows that D~ l A is dissipative. 

Let B be a small enough admissible perturbation of AD. Then there 
exists an admissible perturbation A of A such that B = AD. Since A is 
stably dissipative the matrix A is dissipative as well. Hence there exists 
a positive diagonal matrix D" such that Qad" — 0 > which is equiva¬ 
lent to Q(ad)(d~ 1 d") — 0- This proves that B = AD is dissipative. 
Therefore AD is stably dissipative. 

A similar argument proves that D~ 1 A is stably dissipative. □ 


Definition 3.9. Given a matrix A G Mat nxn (M) and a subset / C 
{1,..., n}, we say that A/ = (%•)(»,i)e/x/ i s the submatrix I x / of A. 

Lemma 3.10. Let A e Mat nxn (R) be a stably dissipative matrix. 
Then, for all I C {1,... ,n}, the submatrix Aj is stably dissipative. 


Proof. Let / C {1 ,,n} and consider an admissible perturbation B = 
{bij)i,jei of A/. Define A = {dij) to be the matrix with entries 


f bij if (i,j) G I x I 
\ aij if {i,j)£lxl 


Clearly, A is an admissible perturbation of A. Hence there exists a 
positive diagonal matrix D such that AD < 0. Letting now Dj be the 
I x I submatrix of D, we see that BDj = (A D)j < 0, which concludes 
the proof. □ 
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Definition 3.11. We call attractor of the LV system (3.2) to the fol¬ 
lowing topological closure 


A A ,q U xe R«U;(:r) , 

where u(x) is the ca-limit of x by the semi-flow : R” —> R+}t>o- 

We need the following classical theorem (see |30, Theorem 2]). 

Theorem 3.12 (La Salle). Given a vector field f(x) on a manifold M, 
consider the autonomous o.d.e. on M, 


x' = fix). 


(3.4) 


Let h : M -A- R be a smooth function such that 

(1) h is a Lyapunov function, i.e., the derivative of h along the flow 
satisfies h{x) := Dh x f(x) < 0 for all x G M . 

(2) h is bounded from below. 

(3) h is a proper function, i.e. {h < a} is compact for all a G M. 
Then (3.4) induces a complete semi-flow on M such that the topological 
closure of all its oj- limits is contained in the region where the derivative 
of h along the flow vanishes, i.e., 


U x6 mw(i) C {x G M: h(x) = 0}. 


The following lemma plays a key role in the theory of stably dissi¬ 
pative systems. 


Lemma 3.13. Given a stably dissipative matrix A, if D is a positive 
diagonal matrix D such that Qad < 0 then for all i = 1,... ,n and 
w G M n 7 

Qad(u>) = 0 auWi = 0. 


Proof. See 40 


□ 


By Theorem 


3.12 


the a 


By the proof Proposition 


tractor is contained in the set {h = 0}. 
3.3 we have h{x) = Qd-^a^x ~ ?)■ Hence 

A A , q C {x G M+ : Q d - i a {x - q) = 0} , 

and by Lemma 3.13 it follows that A AtQ C {x\ Xi = q{\ for every 
i = 1,... ,7i such that an < 0. 


Let us say that a species i is of type • to mean that the following 
inclusion holds A A q C {x : Xi = qi}. Similarly, we say that a species 
i is of type ©, to state that A A , q C {x : X\ (x) = 0}, where X\ (x) 
stands for the i-th component of the vector X A q [x). Equivalently, the 
strategy i is of type © if and only if the sets {aq = const} are invariant 
under the flow (f t Ag : A A ^ q G-\ With this terminology it can be proven 
that 

Proposition 3.14. Given neighbor vertexes j, l in the graph G(A), 
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(a) If j is of type • or© and all of its neighbors are of type •, except 
for l, then l is of type •; 

(b) If j is of type • or © and all of its neighbors are of type • or 
ffi, except for l, then l is of type ©; 

(c) If all neighbors of j are of type • or © 7 then j is of type ©. 


Proof. See 38 


□ 


Based on these facts, Redheffer et al. introduced a reduction algo¬ 
rithm on the graph G(A) to derive information on the species’ types of 
a stably dissipative LV system (3.2). 


Rule 1. Initially, colour black, •, every vertex i such that an < 0, and 
colour white, o, all other vertices. 


The reduction procedure consists in applying the following rules, 
corresponding to valid inference rules: 

Rule 2. If j is a • or (B-vertex and all of its neighbours are •, except 
for one vertex l, then colour l as •; 

Rule 3. If j is a • or (B-vertex and all of its neighbours are • or © 7 
except for one vertex l, then draw © at the vertex l; 


Rule 4. If j is a o -vertex and all of is neighbours are • or © 7 then 
draw © at the vertex j. 

Redheffer et al. define the reduced graph of the system, &(A), as the 
graph obtained from G(A) by successive applications of the reduction 
rules 2-4, until they can no longer be applied. An easy consequence of 
this theory is the following result. 


Proposition 3.15. Let A e Mat n (M) be a stably dissipative matrix 
and consider the LV system (3.2) with an equilibrium q € int(M”). 


(1) If all vertices of&(A) are • then q is the unique globally attrac¬ 
tive equilibrium. 

(2) IfAtf(A) has only • or © vertices then there exists an invariant 
foliation with a unique globally attractive equilibrium in each 
leaf. 


Proof. Item (1) is clear because if all vertices are of type • then for 
every orbit x(t) = ... ,x n (t)) of (3.2), and every i = 1,... ,n, 

one has lim t _> +0O Xi(t) = qi. 

Likewise, if &(A) has only • or © vertices then every orbit of (3.2) 
converges to an equilibrium point, which depends on the initial condi¬ 
tion. But by Proposition |3.5| there exists an invariant foliation & with 
a single equilibrium point in each leaf. Hence, the unique equilibrium 
point in each leaf of & must be globally attractive. □ 









DISSIPATIVE POLYMATRIX REPLICATORS 


11 


Definition 3.16. We say that a dissipative matrix A E Mat nxn (M) is 
almost skew-symmetric iff a tJ = — aji whenever an = 0 or ajj = 0, 
and the quadratic form Qa is negative definite on the subspace 

£ = {w6l": Wi = 0 for all i such that an — 0 } . 


Definition 3.17. We say that the graph G(A ) has a strong link (•—•) 
if there is an edge {i,j} between vertexes i, j such that an < 0 and 
a jj < o. 

Proposition 3.18 (Zhao-Luo [54]). Given A E Mat nxr) ,(R), A is stably 
dissipative iff every cycle of G(A) contains at least a strong link and 
there is a positive diagonal matrix D such that AD is almost skew- 
symmetric. 

Proof. See [541 Theorem 2.3], or [12, Proposition 3.5]. □ 

A compactification procedure introduced by J. Hofbauer 1221 shows 
that every Lotka-Volterra system in R™ is orbit equivalent to a repli¬ 
cator system on the n-dimensional simplex A”. We briefly recall this 
compactification. Let A be a n x n real matrix and r E R n a constant 
vector. The Lotka-Volterra equation associated to A and r is defined 
on R™ as follows 

d z- 

-j£ = Z% ( r i + {Az)i) 1 < i < n . (3.5) 

For each j = 1,. .., n + 1, let <7j { x E A n C R n+1 : Xj — 0 } and 

consider the diffeomorphism 


(^i,..., z n ) i —> 


-e A n \a n+ i 
1 


i + J2 z i 

2—1 


(^i ,..., z n , 1). 


A straightforward calculation shows that the push-forward of the vector 


field (3.5) is equal to -G-X^. where is the replicator vector field 


% n -\-1 


associated to the payoff matrix 



( a n • 

n tA 

A = 

&nl 

T n 


V o . 

. 0 0/ 


Since the flows of -G—X^ and X^ are orbit equivalent, we refer to Xq 


*^n+1 


as the compactification of the LV equation (3.5). 


4. Hamiltonian Polymatrix Replicators 


Definition 4.1. We say that any vector q E R n is a formal equilibrium 
of a polymatrix game (n, A) if 

(a) (Aq)i = ( Aq)j for all i,j E a, and all a — 1,... ,p, 
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( b ) Ejea Qj = 1 for a11 a = l,...,p. 


The matrix A induces a quadratic form Qa 
Qa{w) := w T Aw, where H „ is defined in (2.2). 


Hn —> M defined by 


Definition 4.2. We call diagonal matrix of type n to any diagonal 
matrix D = diag(dj) such that di = dj for all i,j e a and a = 1,... ,p. 


Definition 4.3. A polymatrix game (n, A) is called conservative if it 
has a formal equilibrium q, and there exists a positive diagonal matrix 
D of type n such that Qad = 0 on Hn- 

In |3| we have defined conservative polymatrix game as follows. 

Definition 4.4. A polymatrix game (n, A) is called conservative if 

(a) it has a formal equilibrium, 

(b) there are matrices A$, D e Mat nxn (®0 such that 

(i) (7i, A) ~ (n,A 0 D), 

(ii) Aq is skew-symmetric, 

(iii) D is a positive diagonal matrix of type n. 


However, we will prove in Proposition 4.10 that these two definitions 
are equivalent. 

Let {ei,..., e n } denote the canonical basis in R n , and 14 be the set of 

vertices of r„. Each vertex v G 14 can be written as v — -t- Ye. 

with i a e a, a — 1,... ,p, and it determines the set 


-'Ip 1 


% { (Ma) : i e a, i ^ i a , a = 1,... ,p} 

of cardinal n — p — dim(/h n ). Notice that (i,j) G Y v iff i ^ j are 
in the same group and Vj = 1. Hence there is a natural identification 
% = {i G {1,..., n} : Vi — 0 }. For every vertex v, the family : = 
{ei — e,j : (i,j) G Y v } is a basis of Hn- 

Lemma 4.5. For any vertex v ofT n and x, q G r„ 7 


X - q = (gj-gj) (ei - 6j) . 


Proof. Let v be a vertex of r„. Notice that for all a — 1,... ,p, 


-(®ia = ^{Xi-qi) ■ 

iHa 
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_ P _ 

Y O i - Qi ) ( e i - ej) = Y - 9<)( e i - O 

i£a. 

P P 

= Y^l^ Xi ~ qi "> ei - Y1 _ q ^ ei « 

Qi=l i^ict ot=l i^ia 

iGlOl i£cn 

P P 

= Y ~ ^) e * + - 9iJ e i« 

a=l i^i a a =1 

i£a 

P _ 

= Y ~ qi ) ei = X ~ q 

a=l i£a 


□ 

Given ordered pairs of strategies in the same group (i,j), (k,£), i.e., 
i,j E a and k,£ E (3 for some a, {3 E {1,... ,p}, define 


A (ip)>(k,£) ■ <>ik T Clj£ (kf: &jk ■ 


Proposition 4.6. The coefficients do not depend on the rep¬ 

resentative A of the polymatrix game (n, A). 

Proof. Consider the matrix B = A — C, where the blocks C Q/3 = 
( c ij) iea j e p °f C have equal rows for all a,/3 = 1,... ,p. Let (i,j) E a 
and (k, £) E (3 with a, (3 E { 1,... ,p}. Then 


d3(i..j),(k..t) bik T bjf big bjk 

= — Ck + ajg — eg — an + Q — ajk + Ck 

= A (i,j),(k,£) > 

where Ck is the constant entry on the /d^-column of C°d. □ 


Definition 4.7. Given v E V n , we define A v E Mat^xdOR), d = n — p, 
to be the matrix with entries A^j),{k,i), indexed in Y v x Y v , and G(A V ) 
to be its associated graph (see Dehnition 3.6). 


Proposition 4.8. The matrix A v represents the quadratic form 
Qa : Hn —> R in the basis TS V . 

More precisely, if q is a formal equilibrium of the polymatrix game 
(; n , A) then the quadratic form Qa : H n —y M is given by 


Qa(x — q) — Y A {ij),(k,t) {%i - Qi) (x k - Qk) ■ 

(i,j),(k,£)eT v 


(4.1) 
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Proof. Using lemma 4.5 we have 


Qa(x — q) = ( x i "* &)( e * _ <b) "4 I ^ (T fc - q k )(e k - e*) 

\(*J)6r„ / \(M)er„ 

= ^2 ( e i~e j ) T A(e k -e e )(xi-q i )(x k -q k ) 

^ ' ■^■(i,j),(k,£){xi 5i)(a?fc qk ) , 

(i,j),(k,e)etv 

□ 

Remark 4.9. All matrices with u e VA, have the same rank be¬ 
cause they represent, in different bases, the same (non-symmetric) bi¬ 
linear form Ba ■ Hn x H R — > M, Ba{v, w) := v T Aw. 

Proposition 4.10. Definitions ^. 3\ and 4-4 are equivalent. 

Proof. Given a matrix C with blocks C a ' 3 = ( c ij ) ieajpi3 having equal 
rows for all a, (3 = 1,... ,p, it is clear that Cu,j) } (k,e) — 0 for all pairs 
of strategies (k,£) in the same group. Hence, by Proposition |4.8[ 

Qc vanishes on H n . 

If (n, A) is conservative in the sense of Dehnition |4.4| then there are 
matrices: A 0 skew-symmetric, and D positive diagonal of type n, such 
that (n, A) ~ (n, A 0 D). It follows that (n, 4P _1 ) ~ (n, A 0 ) and as 
observed above the matrix C = AD~ X — A$ satisfies Qc = 0 on 
Finally, since Aq is skew-symmetric, we have Qad - 1 = 0 on H n . In 


other words, ( n , A) is conservative in the sense of Dehnition 4.3 


Conversely, assume that A is conservative in the sense of Dehni- 
Then for some positive diagonal matrix D of type n, Qad- 1 


tion 4.3 


vanishes on II n . 

Let {t>i,... ,n n } be an orthonormal basis of MP where the vectors 
v a — 7Tq,( 1), with a e {1,... ,p}, form a ortho normal basis of H 

and the family {v p+ \,..., u n } is any orthonormal basis of Pin. 

Let rri t] = (AD~ l Vi,vf ), for all i, j = 1,... ,n, so that M = 


represents the linear endomorphism AD 


-i . 


—>■ 


w.r.t. the basis 


{ui,..., v n }. Since Qad- 1 = 0 on Hn, the ( n — p) x (n — p ) sub-matrix 
M' of M, formed by the last n — p rows and columns of M, is skew- 
symmetric. 

Let M 0 G Mat rixn (M) be a skew-symmetric matrix that shares with 
M its last n — p rows. Let A 0 : W 1 —> M n be the linear endomorphism 
represented by the matrix M 0 w.r.t. the basis {iq,... ,u n }, and iden¬ 
tify A 0 with the matrix that represents it w.r.t. the canonical basis. 
Because Mo is skew-symmetric, and {ui ,...,v n } orthonormal, Aq is 
skew-symmetric too. 

Then C = AD — Aq is represented by the matrix M — Mq w.r.t. 
the basis {iq,..., v n }. Since the last n — p rows of M — Mq are zero, 
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the range of C : M. n —y W 1 is contained in Hf. Hence, by Lemma 2.4 
(n,4d _1 ) ~ (n,j 4 0 ), which implies ( n,A ) ~ ( n,A 0 D ). Since A 0 is 
skew-symmetric, this proves that (n, A) is conservative in the sense of 
Definition 14.41 □ 


Remark 4.11. For all w G H 7A , Qd^a^) = Qad{D 1 w). Hence, 
because D //„ = for any diagonal matrix D of type n 

(1) Qad(w) = 0 V w G Hn Qd-^a{w) = 0 V w G H.^. 

(2) Qad{w) < 0 WweHn Qd-^a{w) < 0 V w G H^. 


Lemma 4.12. Given A G Mat nxn (^); if q is a formal equilibrium of 
Xn : A, an d D = diag(dj) is a positive diagonal matrix of type n, then 
the derivative of 

n 

K x ) = T logXi ( 4 - 2 ) 

-t & i 
1=1 

along the flow of X n A satisfies 

h(x) = Qd-ia(x - q) • 


Proof, 
h = 


EE 

ot =1 i£ot 


(flXj, 
di Xi 


EE 

zEct 


Qi. 

d{ 



V 

/3=1 


—q 7 D 1 Ax + x t D 1 Ax = (x — q) 1 D l Ax 
(x — q) T D~ l Ax — (x — q) T D~ l Aq 

"-V-' 

=0 


(x - q) T D l A{x -q)= Qd~^a( x - q). 


To explain the vanishing term notice that for all a G {1,... , p} and 
i,j G a, ( Aq)i = ( Aq)j , d 7 = dj and J2k& a ( x k ~ Qk) =0. □ 


Proposition 4.13. If A is conservative, and q and D = diag(dj) are 
as in Definition f.3. then (4.2) is a first integral for the flow of X r ,a> 
i.e., h = 0 along the flow of X U)A . 

Moreover, X n A is Hamiltonian w.r.t. a stratified Poisson structure 
on the prism Y n , having h as its Hamiltonian function. 


Proof. The first part follows from Lemma 4.12 and Remark 4.11 
second follows from |3, theorem 3.20]. 


The 

□ 


5. Dissipative Polymatrix Replicators 

Definition 5.1. A polymatrix game (n, A) is called dissipative if it has 
a formal equilibrium q, and there exists a positive diagonal matrix D 
of type n such that Qad < 0 on H n . 
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Proposition 5.2. If (n, A) is dissipative, and q and D are as in Defi¬ 


nition 5.1, then 


h ( x ) = j logx 


2 — 1 


di 


is a Lyapunov decreasing function for the flow of X nA , i.e., jjf < 0 
along the flow of X U)A . 


Proof. Follows from Lemma 4.12 and Remark 4.11 


□ 


Definition 5.3. A polymatrix game (n, A) is called admissible if A 
is dissipative and for some vertex v G T n the matrix A v is stably 
dissipative (see Definition 3.7). We denote by V* A the subset of vertices 
v G Vn such that A v is stably dissipative. 

Proposition 5.4. Let q be a formal equilibrium of the polymatrix game 
(; n,A ). Given v G V n and ( i,j ) G Y v , then we have the following 
quotient rule 

d f x r \ x r ^ (x k — q k ) . (5.1) 

UJ (k/)e% 


dt 


Xi 

Xi 


Proof. Let v be a vertex of (i , j ) G Y v , and q be a formal equilib¬ 

rium. Using Lemma 4.5[ we have 

d (Xj\ Xi ,. . . . . . , 

= -A ((Axfl - (Axfl) 


dt 


Xi 


^((Aix-q^-iAix-q))^ 

Jb n ' / 

(e* - efl T A(e k - ef)(x k - q k ) 


E 

3 (k/)e% 


E A(ii, x k • 
3 (k,e)er v 


□ 


Proposition 5.5. If the dissipative polymatrix replicator associated 
to ( n,A ) has an equilibrium q G int (r n ), then for any state Xq G 
int (r n ) and any pair of strategies i,j in the same group, the solution 
x(t) of (2.1) with initial condition x(0) = x 0 satisfies 

for all t > 0 , 


1 xAt) 

- < n ’ < c 

c Xj ( t) ’ 


where c = c(x) is a constant depending on x. 


Proof. Notice that the Lyapunov function h in Proposition 5.2 


is a 


proper function because q G int(r„). Given xq G int (r„), h(x o) = a 
for some constant a > 0. By Proposition A2 the compact set K = 
{x G int(r zi ): h(x) < a} is forward invariant by the flow of X^a- In 
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particular, the solution of the polymatrix replicator with initial condi¬ 
tion x(0) = Xo lies in K. Hence the quotient — has a minimum and a 
maximum in K. □ 


Proposition 5.6. Given a dissipative polymatrix game (n,A), if X n ^ 
admits an equilibrium q G int(T n ) then there exists a X n ^-invariant 
foliation & on int(T n ) such that every leaf of & contains exactly one 
equilibrium point. 


Proof. Fix some vertex v G V n . Recall that the entries of A v are indexed 
in the set Y v = { i G {l,...,n} : ig = 0}. Given a vector w = 
( w i)ie% ^ M n_p , we denote by w the unique vector w G H R such that 
Wi = Wi for all i G Y v . 

Let S C M. n be the affine subspace of all points x G M" such that for 
all a — 1,... ,p and all i , j G a, (Ax); = (. Ax)j and Yhjea x i = 1. By 
dehnition S flint(M") is the set of interior equilibria of X n A- We claim 
that S = {q + w: w G Ker(A„)}. To see this it is enough to remark 
that w G Ker(Ay) if and only if 

(Aw)i - ( Aw)j = (ej - ej) T Aw = 0 V (i,j) G %. 

Given b G Ker(H^), consider the function : int(M") —>■ M dehned 
by (x) := J2j=i^j l°g x j- The restriction of r/ 6 to F n is invariant by 
the flow of Xn,A- Note we can write 


9b(x) = log xi = ^ bi log 

(i,j) eVv 


i=i 


Xi 


X, 


and differentiating g b along the flow of X^a, by Proposition 5.4 we get 


g b (x) = b T A v (x k - q k )k&r v = 0 for all x G r„. 

Fix a basis {6 1? ... ,b k } of Ker(H^), and define g : int(R”) —> 
by g (x) := (g bl (x), ..., g bk {x)). This map is a submersion. For that 
consider the matrix B G Matfc Xn (M) whose rows are the vectors bj, j = 

1,..., k. We can write g(x) = B logx, where logx = (logxi,..., logx n ). 
Hence Dg x = B D~ l , where D x = diag(xi,..., x n ), and because B has 
maximal rank, rarik(R) = k, the map g is a submersion. Hence g deter¬ 
mines the foliation & whose leaves are the pre-images g l {c) = {g = c} 
with c G M fc . 

Let us now explain why each leaf of & contains exactly one point 
in S. Consider the vector subspace parallel to S, E 0 := {w: w G 
Ker(H„)}. Because (n,A) is dissipati ve, A v G Matd X rf(M), d = n — p, 
is also dissipative, and by Proposition 3.4, Ker(A„) and Ker(A^) have 


the same rank. Therefore dim(F'o) = k. Let {cy,..., c n - k } be a basis of 
Eq C M n and consider the matrix C G Mat( n _fc) xn (M) whose rows are 
the vectors Cj, j = 1,..., n — k. The matrix C provides the following 
description S = (x G C (x — q) = 0}. Consider the matrix U = 
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B 

C 


G Mat r 


, which is nonsingular because by Proposition 


3.4 


'Cer(Au) = .DKer(H^), for some positive diagonal matrix D. 

The intersection g _1 (c) fl $ is described by the non-linear system 

B log x = c 
C(x — q) = 0 


x G g l (c)n£ <g> 
Considering u = log x, this system becomes 


B u = c 
C(e u — q) =0 


It is now enough to see that 

B u = c 
C(e u -q) = 0 


and 


B u' = c 
C(e u ' — q) = 0 


imply u = u'. By the mean value theorem, for every i G {1 ,... ,n} 
there is some Ui G such that 


e Ui — e Ui = e u ‘(uj — u'A 


which in vector notation is to say that 

e u — e u = D e u(u — u') = e u * {u — u'). 


Hence 


B (u — u') = 0 


C(e v 


= 0 


& 






B (u — u') = 0 
C D e a (u — u') = 0 

B 


C D r 


(u 


U 


I 

1 

o 

0 

D e n 


-u') = 0 
u — u') — 0 


Therefore, because 


I 

1 

o 

0 

D e a 


is non-singular, we must have u — u 1 . 


Restricting & to int(T n ) we obtain a X n ^~invariant foliation on 
int(T„). Notice that the restriction g| int( , r , : int(T„) —> M. k is invariant 
by the flow of X n ^ because all its components are. 

Since all points in int(r„)n<£ > are equilibria, each leaf of the restricted 
foliation contains exactly one equilibrium point. □ 


Definition 5.7. We call attractor of the polymatrix replicator (2.1) to 
the following topological closure 


A n ,A ■= Uxer„w(a;) , 

where u(x) is the cn-limit of x by the flow : T^ —>• r„}t e ]R. 
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Proposition 5.8. Given a dissipative polymatrix replicator associated 
to (n, A) with an equilibrium q G int (T„) and a diagonal matrix D as 
in Definition^ -c\ we have that 


A n,A Q { x G : Q d - i a (x - q) = 0 } . 


Proof. By Theorem 3.12 the attractor A UtA is contained in the region 

□ 


where h = 0. The conclusion follows then by Lemma 


4.12 


Given an admissible polymatrix replicator associated to (n, A) with 
an equilibrium q G int (T„), we say that a strategy i is of type • to 
mean that the following inclusion holds A r ,a Q {% £ T„: X; = q t }. 
Similarly, we say that a strategy i is of type © to state that A^a Q 
{x G T„: X l nA (x) = 0}, where X l nA {x) stands for the i-th component 
of the vector X nA (x). Given two strategies i and j in the same group, 
we say that i and j are related when the orbits on the attractor A nA 
preserve the foliation { f 1 = const. }. 

For any v G V n we will denote by c© the entries of the matrix A v . 

With this terminology we have 


Proposition 5.9. Given an admissible polymatrix game (n, A) with an 
equilibrium q G int (T„) the following statements hold: 

(1) For any graph G(A V ) with v G V* A : 

(a) if i is a strategy such that v t = 0 and af < 0, then i is of 
type •; 

(b) if j is a strategy of type • or © and all neighbours of j but 
£ in G(A V ) are of type •, then £ is of type •; 

(c) if j is a strategy of type • or © and all neighbours of j but 
£ in G(A V ) are of type • or ©, then £ is of type ffi; 

(2) For any graph G(A V ) with v G V n : 

(d) if all neighbours of a strategy j in ^(^4^) are of type • or 
ffi, then j is related to the unique strategy j', in the same 
group as j, such that Vj< = 1. 


Proof. The proof involves the manipulation of algebraic relations hold¬ 
ing on the attractor. To simplify the terminology we will say that some 
algebraic relation holds to mean that it holds on the attractor. 


Choose a positive diagonal matrix Da 
and set A := D~ X A. By Lemma 3.8 


H n , 

A. and A. 


type n such that Qad < 0 on 
for any v G V n , the matrices 
have the same dissipative and stably dissipative character. 
Hence Vf A = V* A . 

Given v G V* A , for any solution x(t) of the polymatrix replicator in 
the attractor, we have that Q A (x(t) — q) = 0. Hence, as A v is stably 
dissipative and af < 0, by Lemma 3.13 follows that Xi(t) = qi on the 
attractor, which proves (a). 
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Given v G V* A we have that 
tion 15.81 we obtain 


is stably dissipative. 


By Proposi- 


^ 1 Qk) o 


on the attractor. 

Observe that if j is of type • , then Xj = qj, and if j is of type ©, 
then a’jj = A (j,j'),(j,j') — 0; where f is the unique strategy in the same 
group as j such that vy = 1. 

Let j,£ be neighbour vertices in the graph G(A V ). 

Let us prove (6). If j is of type • or © and all of its neighbours are 
of type • , except for £, then 

Ai© ),W)( x z — ^) = 0 , 

from which follows that xt = qt because — djA(j,j'),(e,e’) 7^ 0, 

where £' is the unique strategy in the same group as £ such that vy = 1. 
This proves (6). 

Let us prove (c). If j is of type • or © and all of its neighbours are 
of type • or ©, except for £, then 


A(j,j'),(£,£')( x e ~ Qe) — c, 


for some constant c. Hence because 7^ 0, ay is constant which 

proves (c). 

Let us prove (d). Suppose all neighbours of a strategy j are of type 
• or ©. By the polymatrix quotient rule (see Proposition 5.4), 

Xj 


d 


dt V Xj' 


Al ( 5T ) = 77 E Aih'MM) i x k ~ Qk) 
jl (k,e)er v 


Since all neighbours of j are of type • or © we obtain 

±fxA _ x.j c 


dt V Xj' 


Xj' 


for some constant C. Hence 


x 


— n C ct 
— — n n e 


Xj' 


where Bn = 


x A°) 

X ,, ( 0 ) 


. By Proposition 


we have that the constant C 
must be 0. Hence there exists a constant Bn > 0 such that — = Bn, 

U x U5 


5.5 


which proves (d). 


□ 


Proposition 5.10. If in a group a all strategies are of type • (re¬ 
spectively of type • or (B) except for one strategy i, then i is of type • 
(respectively of type ®). 
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Proof. Suppose that in a group a all strategies are of type • or © except 
for one strategy i. We have that Xk = Ck , for some constant c*,, for each 
k 7 ^ i. Thus, 

x i = 1 - = 1 - Xk = 1 - v Ck ■ 

j£a j=» fc=© j=» fc=© 

Hence i is of type ©. 

If in a group a all strategies are of type •, the proof is analogous. □ 


Proposition 5.11. Assume that in a group a withn strategies, n — k of 
them, with 0 < k < n, are of type • or © ; and denote by S the set of the 
remaining k strategies. If the graph with vertex set S, obtained drawing 
an edge between every pair of related strategies in S, is connected, then 
all strategies in S are of type ©. 


Proof. Since all strategies in a\S are of type • or ©, for the strategies 
in S we have that 

(5.2) 


x, = i - c , 


«eS 

where C — Yljea\s x r 

Let Gs be the graph with vertex set S obtained drawing an edge 
between every pair of related strategies in S. Since Gs is connected we 
have that it contains a tree. Considering the k— 1 relations between the 
strategies in S given by that tree, we have k — 1 linearly independent 
equations of the form Xi = CijXj for pairs of strategies i and j in 


S, where C t j is a constant. Together with (5.2) we obtain k linear 


independent equations for the k strategies in S, which implies that 
Xi = constant, for every i e S. This concludes the proof. □ 


Based on these facts we introduce a reduction algorithm on the set 
of graphs { G(A V ) : v G Vn } to derive information on the strategies of 
an admissible polymatrix game (n,A). 

In each step, we also register the information obtained about each 
strategy in what we call the “information set”, where all strategies of 
the polymatrix are represented. 

The algorithm is about labelling (or colouring) strategies with the 
“colours” • and ©. The algorithm acts upon all graphs G{A V ) with 
v E Vn &s well as on the information set. It is implicit that after each 
rule application, the new labels (or colours) are transferred between the 
graphs G(A V ) and the information set, that is, if in a graph G{A V ) a 
strategy i has been coloured i — •, then in all other graphs containing 
the strategy i, we colour it % — •, as well on the information set. 

Some rules just can be applied to graphs G(A V ) such that v E Vf A , 
while others can be applied to all graphs. 
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Rule 1. Initially, for each graph G(A V ) such that v E V* A colour in 
black (•) any strategy i such that < 0. Colour in white (o) all other 
strategies. 

The reduction procedure consists in applying the following rules, 
corresponding to valid inferences rules. For each graph G(A V ) such 
that v E V* A '. 

Rule 2. If i has colour • or © and all neighbours of i but j in G(A V ) 
are • , then colour j = •. 

Rule 3. If i has colour • or © and all neighbours of i but j in G{A V ) 
are • or ©, then colour j = ©. 

For each graph G(A V ) such that v E V4 

Rule 4. Ifi has colour o and all neighbours of i in G(A V ) are • or ©, 
then we put a link between strategies j and j' in the “information set”, 
where j' is the unique strategy such that vy = 1 and j' is in the same 
group as j. 


The following rules can be applied to the set of all strategies of the 
polymatrix game. 


Rule 5. If in a group all strategies have colour • (respectively, •,© y ) 
except for one strategy i, then colour i = • (respectively, i = ®). 

Rule 6. If in a group some strategies have colour • or © 7 and the 
remaining strategies are related forming a connected graph, then colour 
with © all that remaining strategies. 

We define the reduced information setAH(n, A) as the {•, ffi, o}-coloring 
on the set of strategies {1,..., n}, which is obtained by successive ap¬ 
plications to the graphs G(A V ), v G 14, of the reduction rules 1-6, until 
they can no longer be applied. 


Proposition 5.12. Let ( n,A ) be an admissible polymatrix game, and 
consider the associated polymatrix replicator (2.1) with an interior equi¬ 
librium q G int(r n ). 

(1) If all vertices of &(n, A) are • then q is the unique globally 
attractive equilibrium. 

(2) If&(n, A) has only • or © vertices then there exists an invariant 
foliation with a unique globally attractive equilibrium in each 
leaf. 


Proof. Item (1) is clear because if all strategies are of type • then for 
every orbit x(t) = .. . ,x n (t)) of (2.1), and every i = 1,. .. ,n, 

one has lim^ +oc x t (t) = 

Likewise, if &(n, A) has only • or © vertices then every orbit of 


(2.1) converges to an equilibrium point, which depends on the initial 
condition. But by Proposition 5.6| there exists an invariant foliation 
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& with a single equilibrium point in each leaf. Hence, the unique 
equilibrium point in each leaf of & must be globally attractive. □ 


The following def ini tion corresponds to a one-step reduction of the 
attractor dynamics. 


Definition 5.13. Given a polymatrix game (n, A), a strategy £ G a, for 
some group a, and a point q G int (T„), we call (q, £)-reduction of (n, A) 
to a new polymatrix game (n(£), A(£)) obtained removing the strategy 
£ from the group a, where n(£) := (ni, ..., n Q _i, n a — 1, n a+ 1 ,..., n p ), 
and the matrix A(£) = ( dij (£)) indexed in { 1 , ..., £ — 1 , £ + 1 , ..., n} 
has the following entries: 


dij(£) 


dij dij if J ^ Oi 

{dij - dij)(l - qe) + (an - a n )qe if j G a\ {£} . 


The map tfe ■ Br fl {x e = q e } —>■ T„ w , 'if t (x) = x e = (xf)^, dehnes 
a natural identification. 


Proposition 5.14. Let (n, A) be a polymatrix game with an equilibrium 
q G int (T n ). Given a strategy 1 G a, for some group a, the (q,£)- 
reduction (n(£),A(£)) of (n,A) is such that i/x G T„ fl {xe = qe} and 
Xu,a(x) is tangent to {.xy = qe}, that is X^ A (x) = 0, then for all j i, 



^n{£),A{£) 


(**) 


Proof. Suppose that for some a G {1, ... ,p} there exists £ G a such 
that x G T„ fi {xe = qe} and X^ A (x) = 0. 

Since Xj = 1 — qe, considering the change of variables 


yj ={ l qt 


if j G a \ {£} 
if j £ a 


(5.4) 


we have that Y, j& a \u} Vi = 1 • 

By Proposition 2.5, we can assume A = ( a ^) has all entries equal to 
zero in row £, i.e., a^ = 0 for all j. Thus we obtain 


dxe 

dt 


= x £ 


^(z Q )h4 a V j 

0=1 J 


Hescei makmg T *• the repl,cator equati011 M becomes 

/ \ 


U11UU, lllclKlll^ X£ ■ 

(i) if i G a \ {£}, 
dx. 


dt 


= Xi 


Y.dijXj + aiiqe-Y.11 Q j kj%k'X' j 


j=l 

\j¥4 


kEa ?’=1 
k+t 


(5.5) 


/ 


(ii) if i G (3 7 ^ a, the equation is essentially the same, with xe = qe- 
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Observe that ^ ] P p =1 (x a y A a/3 x^ = 0 because we are assuming that 
x G r„ fl {x£ = qe} and X l nA (x) = 0. 

Hence we can add 


Qe 

1 -qe 


p 

j9=l 


to each equation for with i6« \ {£}, without changing the vector 
held Xn,A at the points x G fl = qe} where X r ,a(x) is tangent 
to {xe = qe}. So equation (5.5) becomes 

/ \ 


dxi 

dt 


= Xi 


Y a v x i+Y Y Q'kjz'k'Kj 

1=1 qe k£a j =1 

\ i¥* k + l ) 


(5.6) 


Now, using the change of variables (5.4), equation (5.6) becomes 

/ \ 


dyi 

dt 


= Vi 


fi ^ ^ Vkfk 


\ 


k£a 

k^i 


(i € a) , 


(5.7) 


7 


where /, = E j&a \{e} M 1 ~ &)%' + a u<U + E^ a a nVr 
Let a = a \ {7}- Setting auq t = auqeiEje&yj), 


dyi 

dt 


- Vi <M - Y dkdk , i e /?, p e {!,..., p} , (5.8) 


fce/3 


where g t = EjeJM 1 “ + a uQe)yj + defines a new 

polymatrix game in dimension n — 1. In fact, (5.8) is the replicator 
equation of the polymatrix game (n(£),A(£)), where, since we have 
assumed that aij = 0 for all j, (5.3) becomes 

a«(Q = ( °« , ^ It* 4 

7 ( <%(1 - qe) + a u qe n j£a. 

□ 


Remark 5.15. Under the assumptions of Proposition |5.14[ when n a = 
2, considering for instance that the group a consists of strategies £—1 
and £, xe = qe implies that xe~\ = 1 — qe = qe- 1 - Hence we can 
further reduce the polymatrix game (n(£),A(£)) to a new polymatrix 
game with type (rii,..., n a _i,w a+ i,..., n p ) and payoff matrix indexed 
in {1, — 2, £+ 1,... ,n}. 

Corollary 5.16. Let ( n,A ) be a polymatrix game with an equilibrium 
q € int (r„). Given a set Qc{l,...,n} of strategies such that 

A n,A Q |>< = ’ 

t&Q 
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then there exists a new polymatrix game (m, B), where m a = \ot \ Q\ for 
every a — 1,... ,p, and an identification if : T„ fl H i&o{ x t — Qi} T™ 
such that Xn : A = X m ,B ° if on the attractor A n,A- 

In other words, the attractor A n,A lives on a lower dimension poly¬ 
matrix replicator of type m. 


Proof. Apply Proposition |5.14| repeatedly. 


□ 


Lemma 5.17. Given a polymatrix game ( n,A ) and a diagonal matrix 
D of type n, we have 

(A D) v = Ay Dy , 


where A v is given in Definition and D v 
dexed in 'Yy — {i E {1,..., n} : Vi — 0 }. 


is the submatrix of D in- 


Proof. Given indices i, k E Y v , take j, resp. £, in the group of i, resp. 
k, such that v 3 — — l. 


Since D is of type n we have c4 = di. By Definition 4.7 


((AZ?) V Jjfe (A D)O'ikdk ~\~ &jidi an.di aj^d^ 

(Aik A aj£ a a Ujk ) dk 
A(ij dk (A w Dyfifc . 


□ 


Lemma 5.18. Let (n, A) be an admissible polymatrix game and D a 


diagonal matrix as in Definition 5.1. Given v G V* A such that vi = 0 


and a v u < 0 for some £ e a with a E {1,... ,p}, there exists a positive 
diagonal matrix D of type nf£) such that ( A(£)D)y is the submatrix of 
(AD) V obtained eliminating row and column l. Moreover 

(a) ( n(£),A (£)) is admissible, and; 

(b) v e v ke),A{iy 


Proof. By Proposition 2.5, we can assume A = (a t j) has all entries 


equal to zero in row £, i.e., aij = 0 for all j. 

Since (n, A) is admissible and v E V* A , ( AD) V is stably dissipative. 
Consider the set / = {i E {1,..., n} : Vi = 0 and a v i{ = 0}. By 
Proposition 


3.18 


the submatrix B v = {df dj)ij e j of ( AD) V = A V D V 


is 


skew-symmetric. 

Let Y n u) be the polytope corresponding to the new polymatrix repli¬ 
cator in lower dimension, given by Proposition |5.14| and defined by 
matrix A(£) = (a^))^. 

Observing that Vi = 0 for all strategies i of the matrix (AD) V , we 
can choose the vertex v in the polytope Tn(i) determined by the exact 
same strategies as v. Notice that zy = 0 for the removed strategy £. 


As in the proof of Proposition 5.14 the matrix A(£) is defined by 


®ij ( l -) 


a. 


i 3 if j i a 

a i:i ( 1 - qi) + auqe if jea 
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= 


— ) V 


Hence 

if j <£ a 

(1 - <u)a v l3 if j G a , 

where a^(£) = ( a,ij(£)) v are the entries of matrix A(£)i 
Considering the positive diagonal matrix 

D = diag ( h,..., 1 . 

V 1 - <u 

we have that (A(£)D)$ is the submatrix B v of (AD) V obtained by re¬ 
moving the row and column corresponding to str ategy £. By Lemma [5. 17 
(A(£)D)y = A(£)y Dy. Hence, by Lemma 


sipative, and consequently, by Lemma 3.8 
tive. 


3.10 


m 


A(£)y Dy is stably dis- 
o is also stably dissipa- 
□ 


Proposition 5.14 and Lemma 5.18 allows us to generalize 111, The 


orem 4.5] about the Hamiltonian nature of the limit dynamics in ad¬ 
missible polymatrix replicators. 


Theorem 5.19. Consider a polymatrix replicator (2.1) on Y n , and as 


sume that the system is admissible and has an equilibrium q G int (r„). 


Then the limit dynamics of (2.1) on the attractor h. n) A is described by 


a Hamiltonian polymatrix replicator in some lower dimensional prism 


Proof. By definition there exists a vertex v G T„ such that A v = (a]' ) 


is stably dissipative. Applying Proposition 5.14 and Lemma 5.18| we 
obtain a new polymatrix replicator in lower dimension that is admissi¬ 
ble. 

We can iterate this process until the corresponding vertex v in the 
polytope is such that, a v it = 0 for all i with v i = 0. 

Let us denote the resulting polymatrix game by (r, A 1 ). By Propo¬ 
sition 3.18, for some positive diagonal matrix D' of type r, (A' D')y 
is skew-symmetric. Hence Qa'd' = 0 on H r: and by Definition E3 
the polymatrix game (r, A ) is conservative. Notice that this polyma¬ 
trix game has essentially the same formal equilibrium up to coordinate 
rescalings. Thus by Proposition 4.13 the vector held X Lj a> is Hamil¬ 
tonian. □ 


6. An Example 

Consider the polymatrix replicator system associated to the polyma¬ 
trix game Q = ((3, 2), A), where 


-1 

8 

-7 

3 

-3 

-10 

-1 

11 

3 

-3 

11 

1 

—j 

1 

-6 

6 

-3 

-3 

6 

0 

0 

3 

3 

-6 

0 

0 
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We denote by Xg the vector field associated to this polymatrix repli¬ 
cator defined on the popytope T( 3)2 ) = A 2 x A 1 . 



FIGURE 1. Four orbits in two different leafs of the polymatrix 
game Q. 


In this example we want to illustrate the reduction algorithm on 
the set of graphs { G(A V ) : v G 14,3,2) } to derive information on the 
strategies of the polymatrix game Q as described in section [5] We will 
see that this polymatrix game is admissible and verify the validity of 
the conclusion of Theorem |5. 19| for this example. 


vi = (1,4) v 2 — (1, 5) v 3 — (2,4) v 4 = (2, 5) n 5 = (3,4) v 6 = (3,5) 

TABLE 1. Vertex labels. 

In this game the strategies are divided in two groups, {1,2,3} and 
{4,5}. The vertices of the phase space T( 3)2 ) will be designated by 
pairs in {1,2,3} x {4,5}, where the label (i,j) stands for the point 
ei + ej E T (3j 2 ) • To simplify the notation we designate the prism vertices 
by the letters v 4 ,... ,v 6 according to table [TJ 
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Vertex 


A 


G(A V ) 


V 1 e V n,A 


V 2 ^ V*' A 


V 3 ^ KT,A 


0 27 0 

-27 -9 18 

0 -18 0 

0 27 0 

-27 -9 -18 
0 18 0 

'0 -27 O' 

27 -9 18 

0 -18 0 



0 

-27 

0 

e V n,A 

27 

-9 

-18 


0 

18 

0 


'-9 

18 

-18' 

V 5 £ Vn,A 

-36 

-9 

-18 


18 

18 

0 


"-9 

18 

18' 

V 6 £ V n,A 

-36 

-9 

18 


-18 

-18 

0 


a 


o - 


o 


o 


-o 


■o 


■o 


■o 


■o 


-o-o 


■o 




TABLE 2. Matrix A v and its graph G(A V ) for each vertex v. 


The point q G int (T^)) given by 


Q = 


11111 

3’ 3’ 3’ 2’ 2 


is an equilibrium of our polymatrix replicator Xg. In particular it is 
also a formal equilibrium of Q (see Definition 4.1). 

The quadratic form Qa ■ 77(3,2) -A- M induced by matrix A is 

Qa{x) = -9xg, 


where x = (xi,X 2 ,X 3 ,X 4 ,X 5 ) G 77( 3 , 2 ). By Definition 5.1 Q is dissipa¬ 
tive. 

In table [2] we present for each vertex v in the prism the corresponding 
matrix A v and graph G(A V ). 
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Step 

Rule Vertex 

Strategy 

Group 1 

Group 2 




O 

O • 

2 3 

O O 

4 5 

1 

1 t’l, V 2l v 3 , v 4 

3 

1 


4 V 4 (or n 5 ) 

4,5 

O 

1 

O • 

2 3 

O—O 

4 5 

2 

3 

6 

4,5 

O 

1 

O • 

2 3 

© © 

4 5 



1,2 

© 

0 • 

© © 

4 5 

4 

3 v 1 ,v 2 

1 

2 3 


TABLE 3. Information set of all strategies (by group) of Q, where 
for each step, we mention the rule, the vertex (or vertices) and the 
strategy (or strategies) to which we apply the rule. 


we 

g 


Considering vertex v\ = (1,4) for instance, by Proposition 3.18 
have that matrix A Vl is stably dissipative. Hence, by Definition 5.3 
is admissible and V\ E V* A . 

Table [3] represents the steps of the reduction procedure applied to Q. 
Let us describe it step by step: 

(Step 1) Initially, considering the vertices v\, v 2 , v$ and tq we apply rrde[7] 
to the corresponding graphs G(A Vl ), G(A V2 ), G(A V3 ) and G(A Vi ), 
and we colour in black (•) strategy 3. We obtain the graphs 
depicted in column “Step 1” in table [4j 

(Step 2) In this step we can consider vertex u 4 (or v 5 ) to apply rule |^J 
Hence, we put a link between strategies 4 and 5 in group 2; 

(Step 3) In this step we apply rule [3] to strategies 4 and 5, and we colour 
with © that strategies. We obtain the graphs depicted in col- 
‘Step 3” in table J3J 

to vertices v - 2 and u 3 in the correspond¬ 
ing graphs of the column “Step 3” in table [4], and we colour with 
© the strategy 2. Analogously we apply rule [3] to vertices v\ 
and V;$ in the corresponding graphs of the column “Step 3” in 
table [|| and we colour with © the strategy 1. We obtain the 
graphs depicted in column “Step 4” table [4j 

Since Q is admissible and has an equilibrium q E int (F( 3j2 )), by 
Theorem 5.19 we have that its limit dynamics on the attractor Ag is 
described by a Hamiltonian polymatrix replicator in a lower dimen- 


umn 

(Step 4) Finally, we apply rule 


sional prism. Considering the strategy 3 in group 1, by Definition 5.13 


we obtain the (g, 3)-reduction ((2,2),T(3)) where A := A(3) is the 
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Vertex Step 1 Step 3 Step 4 


Vl 


O-•-O O-•-© 0-•-0 


V2 


O-•-O O-•-0 0-•-0 


V3 


O-•-O O-•-0 ©-•-0 



TABLE 4. The graphs obtained in each step of the reduction 
algorithm for Q. 


matrix 


-9 

9 

9 

-9 

-9 

9 

9 

-9 

-6 

6 

6 

-6 

-6 

6 

6 

-6 


A = 


Consider now the polymatrix replicator associated to the game 
Q = ^(2,2),A^, which is equivalent to the trivial game ((2, 2), 0). 

Hence its replicator dynamics on the polytope T( 2 j 2 ) = A 1 x A 1 is 
trivial, in the sense that all points are equilibria. In particular the 
associated vector held Xg = 0 is Hamiltonian. 

Since the reduced information set M{Q) is of type {•, 0}, by Propo¬ 


sition 5.12 the how of Xg admits an invariant foliation with a single 
globally attractive equilibrium on each leaf (see Figure [I]). Therefore, 
the attractor Kg is just a line segment of equilibria, which embeds in 


the Hamitonian how of Xg = 0, as asserted by Proposition 5.14 
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